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Abstract 

We present the first exact analysis of some of the temporal properties of multivariate self-excited 
Hawkes conditional Poisson processes, which constitute powerful representations of a large variety 
of systems with bursty events, for which past activity triggers future activity. The term "multi- 
variate" refers to the property that events come in different types, with possibly different intra- 
and inter-triggering abilities. We develop the general formalism of the multivariate generating mo- 
ment function for the cumulative number of first-generation and of all generation events triggered 
by a given mother event (the "shock") as a function of the current time t. This corresponds to 
studying the response function of the process. A variety of different systems have been analyzed. 
In particular, for systems in which triggering between events of different types proceeds through a 
one-dimension directed or symmetric chain of influence in type space, we report a novel hierarchy 
of intermediate asymptotic power law decays ~ of the rate of triggered events as a 

function of the distance m of the events to the initial shock in the type space, where < < 1 for 
the relevant long-memory processes characterizing many natural and social systems. The richness 
of the generated time dynamics comes from the cascades of intermediate events of possibly different 
kinds, unfolding via a kind of inter-breeding genealogy. 



Electronic address: saichev@hotmail.com,dsornette@ethz.ch 



I. INTRODUCTION 



We study a class of point processes that was introduced by Hawkes in 1971 



[Jfl. It 



IS 



much richer and relevant to most natural and social systems than standard point processes 



10|, because it describes "self-excited" processes. This term means that the past events 
have the ability to trigger future events, i.e., X{t\Ht) is a function of past events, being 
therefore non-markovian. Many works have been performed to characterize the statistical 
and dynamical properties of this class of models, with applications ranging from geophysical 
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-|l6|. medical 17|] to financial systems, with applications to Value-at-Risk modeling 18| . 



ligh- frequency price processes [19| , portfolio credit risks |20l| , cascades of corporate defaults 

2l|, financial contagion 22|, and yield curve dynamics |23|. 

While surprisingly rich and powerful in explaining empirical observations in a variety 
of systems, most previous studies have used mono-variate self-excited point processes, i.e., 
they have assumed the existence of only a single type of events, all the events presenting 
some ability to trigger events of the same type. However, in reality, in many systems, events 
come in different types with possibly different properties, while keeping a degree of mutual 
inter-excitations. 

• Earthquakes are partitioned in different tectonic regions. 

• Neuronal excitations in the brain come in different types, such as spikes, bursts and 
seizures. In addition, epileptic seizures involve different brain structures at different 
scales. 

• Financial volatility bursts occur at a given time on some assets and not on others. 

• Defaults on debts may start and develop preferentially on some firms in some industrial 
sectors. 

• Some countries within a currency block may start to exhibit specific sovereign risks 
and not other countries. 

• Only a subset of the population of bloggers or of developers may be active at any time. 

Notwithstanding the existence of such different types, categories or locations, events of one 
type may trigger both new events of the same type as well as of different types. For instance. 
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1. there is now convincing evidence of earthquake triggering at large distances across 
tectonic plate boundaries. 

2. Epileptic seizures are nowadays believed to be able to trigger large scale neuronal 
excitations over largely different brain structures. It is possible that even neuronal 
spikes, bursts or different types of subclinical epileptic seizures may play a role in 
triggering clinical epileptic seizures of different types in distinct cortical structures. 

3. The hectic price movement of a given stock may trigger by contagion large volatil- 
ity bursts in other stocks or assets, via technical or behavioral transfer mechanisms. 
Financial volatility bursts occurring for one asset may trigger future volatility fluctu- 
ations for other assets. 

4. The shocks due to defaults of some firms may jump across industries to encompass 
different branches through a chain reaction. 

5. Countries of different regions and currencies may become coupled through the direct 
and indirect flows of international commerce as well as mutual debt ownerships. 

6. The activity of a blogger or a developer may be encouraged by previous actions of 
other agents, leading to future commits triggered by previous commits of different 
people. 

These observations suggest that multivariate self-excited point processes, which extend 
the class of mono-variate self-excited point processes, provide a very important class of 
models to describe the self-excitation (or intra-triggering) as well as the mutual influences 
or triggering between different types of events that occur in many natural and social systems. 
Actually, the generalization to multivariate self-excited point processes was mentioned by 
Hawkes himself in his first paper but the full relevance of this class of models has only 



been recently appreciated 



22 



The organization of the paper proceeds as follows. Section 2 first recalls the definition 
of the monovariate Hawkes process and then presents the general multivariate self-exciting 
Hawkes processes. Section 3 develops the formalism of the multivariate generating moment 
function for the cumulative number of first-generation and of all generation events triggered 
by a given mother event as a function of the current time t. Section 4 provides the general 
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relations to obtain the mean numbers of events triggered over all generations by a given event 
as a function of time. Section 5 analyzes a system in which the intra-type triggering processes 
are all of the same efficiency while all inter-type triggering processes have themselves the 
same efficiency between themselves but in general weaker than the intra-type triggering 
processes. We derive the time-dependence of the rates of events triggered from a given 
shock for distributions of waiting times of first-generation events that have either exponential 
or power law tails. Section 6 analyzes a system in which triggering between events of 
different types proceeds through a one-dimension directed chain of influence in type space. 
We uncover a novel hierarchy of intermediate asymptotic power law decays of the rate of 
triggered events as a function of the distance of the events to the initial shock in the space of 
types. Section 7 generalizes the results of section 6 by studying a system in which triggering 
between events of different types proceeds through a one-dimension symmetric chain of 
influences in type space. Two appendices give proofs and details of the key results of the 
paper. 

II. DEFINITIONS AND NOTATIONS FOR THE MULTIVARIATE HAWKES 
PROCESSES 

A. Monovariate Hawkes processes 

Self-excited conditional Poisson processes generalize the cluster models by allowing each 
event, including cluster members, i.e., aftershocks, to trigger their own events according to 
some memory kernel h{t — ti). 

Xit\Ht,Q) = X,it)+J2fit-t^) , (1) 

i\ti<t 

where the history Ht = {ti}i<j<it, ti^<t<u^+-i includes all events that occurred before the 
present time t and the sum in expression ([T]) runs over all past triggered events. The set of 
parameters is denoted by the symbol 0. The term Xc{t) means that there are some external 
background sources occurring according to a Poisson process with intensity Ac(t), which may 
be a function of time, but all other events can be both triggered by previous events and can 
themselves trigger their offsprings. This gives rise to the existence of many generations of 
events. 



4 



Introducing "marks" or characteristics for each event leads to a first multidimensional 
extension of the self-excited process ([1]) . The generalization consists in associating with each 
event some marks (possible multiple traits), drawn from some distribution p{m), usually 
chosen invariant function of time: 

X{t, M\H„ 6) = p{M) I Kit) +J2f{t- U, M,) j , (2) 

\ i\ti<t J 

where the mark Mj of a given previous event now controls the shape and properties 
of the triggering kernel describing the future offsprings of that event i. The history 
now consists in the set of occurrence times of each triggered event and their marks: 
Ht = {ti, Mi}i<i<i^^ u^<t<ti^+i- The first factor p{M) in the r.h.s. of expression (|2]) writes 
that the marks of triggered events are drawn from the distribution p{M), independently 
of their generation and waiting times. This is a simplifying specification, which can be re- 
laxed. Inclusion of a spatial kernel to describe how distance impacts triggering efficiency is 
straightforward. 

A particularly well-studied specification of this class of marked self-excited point process 
is the so-called Epidemic- Type- Aftershock-Sequence (ETAS) model fll. 26|: 



/ h. a{Mi-Mo) \ 

A(t, M\H„ 6) = p(M) iXc+Yl ^t-U + cy-^<^ ' 

\ i\ti<it J 

where pirn) is given by the Gutenberg-Richter law, which describes the probability density 
function (pdf ) of earthquakes of a given energy as being a power law, which translates into 
an exponential function p{M) ~ e"**^^ of the log-energy scales inscribed in magnitudes M's. 
The memory kernel is often chosen as the power law (called the Omori law) with exponent 
1 + 6 and usually < < 1. The time constant c ensures finiteness of the triggering rate 
immediately following any event. Other forms with shorter memory, as the exponential, 
are also common. Each event (of magnitude M ^ Mq) triggers other events with a rate 
~ e"*^, which defines the so-called fertility or productivity law. The lower magnitude cut- 
off Mq is such that events with marks smaller than Mq do not generate offsprings. This 
is necessary to make the theory convergent and well-defined, otherwise the crowd of small 



events may actually dominate |27l . l28l | . The constant k controls the overall productivity law 
and thus the average branching ratio defined by expression (jlj) below. The set of parameters 
is 9 = {b, Ac, k, a, Mq, c, 9}. 



From a theoretical point of view, the Hawkes models with marks has been studied in 
essentially two directions: (i) statistical estimations of its parameters with corresponding 



residual analysis as goodness of fits |39|-|48| : (ii) statistical properties of its space-time dy- 



namics 



15 
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The advantage of the self-excited conditional Hawkes process is to provide a very parsi- 
monious description of the complex spatio-temporal organization of systems characterized 
by self-excitatied bursts of events, without the need to invoke ingredients other than the 
generally well-documented stylized facts on the distribution of event sizes, the temporal 
"Omori law" for the waiting time before excitation of a new event and the productivity law 
controlling the number of triggered events per initiator. 

Self-excited models of point processes with additive structure of their intensity on pas t 
events as in (|2]) and (|3]) [4] make them part of the general family of branching processes 49 1. 
The crucial parameter is then the average branching ratio n, defined as the mean number 
of events of first generation triggered per event. Using the notation of expression (IHl), the 
average branching ratio is given by 

Depending on applications, the branching ratio n can vary with time, from location to 
location and from type to type (as we shall see below for the multivariate generalization). 
The branching ratio provides a diagnostic of the susceptibility of the system to trigger 
activity in the presence of some exogenous nucleating events. 

Precise analytical results and numerical simulations show the existence of three time- 
dependent regimes, depending on the "branching ratio" n and on the sign of 9. This clas- 
sification is valid for the range of parameters a < b. When the productivity exponent a 
is larger than the exponent b of the Gutenberg-Richter law, formula (jl]) does not make 
sense anymore, which reflects the existence of an explosive regime associated with stochastic 
finite-time singularities 29|], a regime that we do not consider further below, but which is 



relevant to describe the accelerated damage processes leading to global systemic failures in 



possibly many different types of systems [50 1 . 



1. For n < 1 (sub-critical regime), the rate of events triggered by a given shock decays 
according to an effective Omori power law ~ 1/t^, characterized by a crossover from 



an Omori exponent p = 1 — ^ for t < t* to a larger exponent p = 1 + for t > t* 



where t* is a characteristic time t* ~ c/(l — nY^^, which is controlled by the distance 
of n to 1. 



2. For n > 1 and > (super-critical regime), one finds a transition from an Omori 
decay law with exponent p = 1 — 6 aX early times since the mainshock to an explosive 



exponential increase of the activity rate at times t > t* ^ c/{n — 1)^^^ 15|, l51 |. 



3. In the case ^ < 0, there is a transition from an Omori law with exponent 1 — |0| 
similar to the local law, to an exponential increase at large times, with a crossover 
time T different from the characteristic time t* found in the case ^ > 0. 

We refer in particular to Ref. [17] for a short review of the main results concerning the 
statistical properties of the space-time dynamics of self-excited marked Hawkes conditional 
Poisson processes. 

B. Multivariate Hawkes processes 

The Multivariate Hawkes Process generalizes expressions ([2]) and ([3]) into the following 
general form for the conditional Poisson intensity for an event of type j among a set of m 



possible types (see the document 25| for an extensive review): 

m „ 

Xj{t\Ht) = X°j{t) + J2 K / fkAt - s) 9k{x) Nk{ds X dx) , (5) 

J{-oo.i)xTl 



k=l 



'(-oo,^)x7^ 

where Ht denotes the whole past history up to time t, is the rate of spontaneous (exoge- 
nous) events of type j, i.e., the sources or immigrants of type j, Akj is the (/c,j)'s element 
of the matrix of coupling between the different types which quantifies the ability of a type 
/c-event to trigger a type j-event. Specifically, the value of an element Akj is just the average 
number of first-generation events of type j triggered by an event of type k. This generalizes 
the branching ratio n defined by (jlj). The memory kernel fk,j{t — s) gives the probability that 
an event of type k that occurred at time s < t will trigger an event of type j at time t. The 
function fk,j{t — s) is nothing but the distribution of waiting times t — s between the impulse 
of event k which impacted the system at some time s and the occurrence of an event of type 
j at time t. The fertility (or productivity) law gk{x) of events of type k with mark x quanti- 
fies the total average number of first-generation events of any type triggered by an event of 
type k. We have used the standard notation /(_^ j-)^^ fit, x)N{ds x dx) := ^ji^.^^ f(ti, Xi). 



The matrix K^j embodies both the topology of the network of interactions between dif- 
ferent types, and the couphng strength between elements. In particular, K^j includes the 
information contained on the adjacency matrix of the underlying network. Analogous to the 
condition n < 1 (subcritical regime) for the stability and stationarity of the monovariate 
Hawkes process, the condition for the existence and stationarity of the process defined by 
([5]) is that the spectral radius of the matrix Kkj be less than 1. Recall that the spectral 
radius of a matrix is nothing but its largest eigenvalue. 

To our knowledge, all existing works on the multivariate Hawkes processes assume that 
the first moment of the memory kernel fk,j{i ~ s) exists. In the notations analogous to 
those of equation ([3]), if the memory kernels have an Omori like power law tail ~ 
this first-order moment condition imposes that 9 > 1. But, this is not the correct regime of 
parameters for earthquakes as well as for other social epidemic processes, which have been 



shown to be characterized by long-memory processes with < < 1 [52h55||. This regime 
< < 1 leading to infinite first-order moments leads to very rich new scaling behaviors 
in the multivariable case, as we are going to show below. Actually, we will derive the 
remarkable results that multivariate Hawkes processes can be characterized by a hierarchy 
of dynamics with different exponents, all related to the fundamental Omori law for first 
generation waiting times. 



III. TEMPORAL MULTIVARIATE GENERATING MOMENT FUNCTION 
(GMF) 

A. Generating moment function for the cumulative number of first-generation 
events triggered until time t 



Among the m types of events, consider the A;-th type and its first generation offsprings. 
Let us denote . . . the cumulative number of "daughter" events of 

first generation of type 1, 2, . . . , m generated by this "mother" event of type k from time 
until time t. With these notations, the generating moment function (GMF) of all events of 
first generation that are triggered by a mother event of type k until time t reads 



^i{yi^y2,---,ym;t) ■= e 



s=l 



(6) 
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where E [X] denotes the average of X over all possible statistical reahzations. We shall also 
need the definition of the GMF y2, ■ ■ ■ , Z/m) defined by 



A'l{yi,y2,...,ym) := E 



(7) 



Ls=i 

where = lim,^+„o Ri'\t), r1^^ = limt^+^ R\^\t), rI^"^ = limt^+^ i?t""(t) are the 
cumulative number of "daughter" events of first generation of type 1, 2, . . . , m generated by 
the "mother" event of type k over all times. One may rewrite this function in probabilistic 
form 

oo oo m 

A'l(yi,y2,...,ym) -I]-" I] Pkin, . . . ,rm)Y[y'/ , (8) 

ri=0 rm=0 s=l 

where Pfe(ri, . . . , r^) is the probability that the mother event of type k generates R'''^ — ri 
first- generation events of type 1, R'^''^ — r2 first-generation events of type 2, and so on. 

The events are assumed to occur after waiting times between the mother event and their 
occurrences that are mutually statistically independent and characterized by the proba- 
bility density functions (pdf) {fk,s{t)}, where all fk,s{t) = for t < 0. Let us denote 
Vk{di,d2, . . . ,dm]t) the probability that the cumulative numbers {R'l'^{t)} up to time t of 
first-generation events that have been triggered by the mother event of type k are equal to 

R1^\t) = d^, Rl'\t) = d2, ... Rl''\t) = dm. (9) 

Let us relate this probability Vk{di,d2, . ■ ■ ,dm',t) to that, denoted 
Vk{di, d2, ■ ■ ■ , dm] t\ri, r2, . . . , r^), obtained under the additional condition that the 
total numbers of first-generation events that have been triggered by the mother event 
of type k over the whole time interval i — > oo are fixed at the values {ri, r2, . . . , r^}. 
Obviously, Vk{di, d2, ■ ■ ■ , dm] t\ri, r2, . . . , r^) is given by a product of binomial distributions 

Vk{di, d2,..., dm-, t\n, r2,...,rm)^T\rj )l^tW - l^k,sit)Y'~''' , 

7=1 W (10) 

^ di ^ ri, ... ^dm^Tm , 

where 

ft 



l^k,sit) = / fk,s{t')dt' ■ (11) 
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Knowing the conditional probabilities Vk{di,d2, . . . , dm', t\ri,r2, . . . , r^) (flOll . one can cal- 
culate their unconditional counterparts using the following relation 

Vk{di,d2, ...,dm;t) = 

^ ^ (12) 
■ ■ ■ 'Pk{di, d2,..., dm] t\ri,r2, rm)Pk{ri, r2, . . . , r^) , 

ri=di rm=dm 

where Pk{f'i,r2, . . . ,rm) is the probability that the total numbers of first-generation events 
that have been triggered by the mother event of type k over the whole time interval t — t- oo 
take the values {ri, r2, . . . , r^}- 

Substituting the relations ffTU]) in f[T^ yields 

Vk{di,d2, ...,dm]t) = 
oo ™ /r \ (13) 

^^(^1' • • • '^™) n ( rf>M(^)[l - /^M(i)]"-'^ • 

The interest in this expression f|T3l) is that the GMF A'l{yi,y2, . . . yZ/m^t) defined by expres- 
sion ([H]) can be rewritten in probabilistic form as 

cx) oo m 

A'l{y,,y2,...,ym;t) = J2 ' ' ' Yl Vk{du ■ ■ ■ ,dm;t)l[yf . (14) 

dl=0 dm=0 s = l 

We are now prepared to state the following theorem, which is essential for our subsequent 
derivations. 

Theorem 3.1 The GMF A^{yi,y2, . . . ,ym'it) defined by expression ^ can be represented 
in the form 

A\{yi,y2, . . . ,ym]t) = Qfc[/ifc,i(t)(2/i - 1), • • • , /ifc,m(t)(l/m - 1)] , (15) 

where 

Qk{zi,...,Zm) := A\{l + zi,...,l + Zs) ^ A5=(yi,...,?/„) = Qfc(?/i -!,...,?/„ -1) . (16) 
The proof is given in Appendix A. 



B. GMF for the cumulative numbers of events over all generation triggered until 
time t 



Let us define the GMF 



A''{yi,y2,...,ym;t) := E 



(17) 
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where {R^'^{t)} is the total number of events summed over all generations of events of type 
s triggered by a mother event of type k starting at time up to time t. 

Due to the branching nature of the process, the equation determining the GMF 
{A''{yi, ?/2, • • • , Vm; t)} is obtained by 

1. replacing in the left-hand-side of expression (fT5|) A'l{yi,y2, ■ . ■ ,ym',t) by 
A''{yi,y2, ■ ■ ■ ,ym',t); this means that we deal with events of all generations oc- 
curring till current time t; 

2. replacing in the right-hand-side of expression f fTSj) the arguments ys by 

Vs ys [ fkAt'\t)A%yi,...,ym;t-t')dt' , (18) 

Jo 

where {fk,s(t'\^)} conditional pdf of the random times {t^^} of occurrence of 

some first-generation event of type s triggered by the mother event of type k, under 
the condition that it occurred within the time interval t' G {0,t). The conditional pdf 
is given by 

= ^ , (19) 

where fik,s(t) is defined by (fTTl) . The pdf fk,sit'\t) inside the integral ( fTSl) takes into 
account that first-generation events are occurring at random times t' < t. The other 
factor A^{yi, . . . ,y„i;t — t') takes into account all-generation events that are triggered 
by some first-generation event from its appearance time t' till the current time t. 

The equation for the GMF {A'^d/i, 2/2, • • • , l/m! ^)} is thus 

A\y,,y2, ...,ym;t) = Qk [B^'^iyi, . . . , y^; t), . . . , 5'=''"(i/i, . . . ,y^; t)] , (20) 

where 

B'''%y,,...,y^;t)= [ h^^it - t')[ysA\y,, . . . ,y^;t') - l]dt' . (21) 
Jo 

IV. GENERAL RELATIONS FOR THE MEAN NUMBERS OF EVENTS OVER 
ALL GENERATION TRIGGERED UP TO TIME t 

The set of equations fl20l) together with the relations fl2T|) provides the basis for a full 
description of the statistical and temporal properties of multivariate branching (Hawkes) 
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processes. Here, we restrict our attention to the average activities, by studying the temporal 
dependence of the average number of events following the occurrence of a mother event of a 
given type. 

The mean number of events of type s over all generations counted until time t that are 
triggered by a mother event of type k that occurred at time t = 0, defined by 

R'^'^it) := E[i?'='^(t)] , (22) 

is given by the relation 

R'At) = ^A\y„ 1/2, ... , Vm-, t)\...-, -1 , (23) 

where A''{yi, y2, . . . , ym] t) satisfies to the set of equations ( l20l) . 

In order to derive the equations determining the set {R^'^{t)}, we need to state 
the following properties exhibited by the functions Qk{yi, ■ ■ ■ ,Um) given by f flGl) and 
B'^''^{yi,y2, . . . ,yn',t) given by (12T|) . which are contributing to equation (120|) . From the 
definition of the functions B^''^{yi,y2, . . . ,yn',t) and of the GMF A^{yi,y2, . . . , ym'i t), we 
have 



B'Ayuy2,...,yn,t)l^^...^^^^,^o (24) 

and 

—B''\y,,y2,...,yn]t,r)\ = f^kAt) ■ ks + fkAt) ® R^'^t) ■ (25) 

(Jy^ I J/1— — J/m — i 

The convolution operation is defined as usual by /(t) ®5'(t) := /g f{t — t')g{t')dt'. Moreover, 
the following equality holds 

d 

-^QkiVi, Z/2, • • . , Vn] t, r) = nk,s , (26) 

(jy^ I J/1- -J/m-U 

where Uk^s is the mean value of the total number of first-generation events of type s triggered 
by a mother of type k. The set {nk,s} for all fc's and s's generalize the average branching 
ratio n defined by expression (jlj) above for monovariate branching processes and are given 
by 

d 

= Ws"^'^^'' ■ ■ ■ ' y'^^\y^=-=yr^=^ ^^^^ 

where A^{yi, y2, ■ ■ ■ , ym) is defined in ([7]). 

Using the above relations fl24ti26p . the equality fl25]) together with equation f l2U]) yields 

m 

R'^^'it) = nk,s ■ fikAt) + Yl ^k,efkAt) ® R''%t) ■ (28) 



e=i 
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Introducing the event rates, i.e., the number of events per unit time, 

~dt 



/ ■(«) = . (29) 



expression ( l28ll transforms into 

m 

where we have used the following notation 

nkA^) ■= '^k,s ■ fk,s(t) ■ (31) 

The set of equations fl30l) for all fc's and s's constitute the fundamental starting point of our 
analysis. 

In order to make further progress, in view of the convolution operator, it is convenient 
to work with the Laplace transform of the event rates: 

~k,s/„,\ / Jt .s ( A.\ ^—ut , 



p^^'[u) = / p''''{t)e-'''dt . (32) 
Jo 

Introducing the matrices 

= [p'^'^u)] and N{u) = [fikM] , (33) 
we obtain the following equation for the matrix $(«) 

/ $(«) = N{u) + N{u) <I(m) , (34) 

whose solution is 

/ — N{u) 

The rest of the paper is devoted to the study of this solution fl35l) for various system structures 
and memory kernels. 

V. SYMMETRIC MUTUAL EXCITATIONS 
A. Definitions 

Let us consider the case where the set {nfc^s} defined by expression ( !27l) reduces to 

nk,k = a ; nk,s = b, k s , (36) 

13 



This form (136|) means that events of a given type have identical triggering efficiencies quan- 
tified by a to generate first-generation events of the same type. They also have identical 
efficiencies quantified by h to trigger first-generation events of a different type. As a con- 
sequence, the mean number of first-generation events of all kinds that are triggered by a 
mother event of some type /c, 

m 

nfc = ^ nk,s , (37) 

s=l 

is independent of k and given by 

Hk = n = a + {m — 1)6 , for all k . (38) 

Introducing the factor 

q = - (39) 

a 

comparing the inter-types with the intra-type triggering efficiencies, we obtain 

n ^ nq , ^ . 

a = 7 7^ ' ^ = , ,^ • (40) 

1 + (m - l)g 1 + (m - l)g ^ ^ 

In the time domain, we consider the case of symmetric mutual excitations such that all 

pdf's fk,s{t) = fit) are independent of the indexes k and s and are all equal to each other. 

B. General solution in terms of Laplace transforms 

With the definitions of subsection IV At it follows that hk^s{u) = n f{u) and one can 
show that all diagonal and non-diagonal entries of the matrix $(n) given by (1351) are given 
respectively by 

~k±t.\ ^hu) l + nf{u){q-l) 



p{u) := p'^'iu) 



l-nf{u) l + nf{u){q- 1) + q{m- 1) ^^^^ 

~giu) := P^n) = , k^s. 

1 — nf{u) 1 + nf[u){q — 1) + q{m — 1) 

Moreover, the Laplace transform 

m 

p\u) = P'^'iu) = p{u) + (m - iyg{u) (42) 

s=l 

of the total rate of events of all types triggered by a mother jump of type k defined by 
P^if) = J2T=i P^'^^if) satisfies the relation 

p\u) = . (43) 

1 - nf{u) 
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C. Exponential pdf of triggering times of first-generation events 



Let us first study the case where the pdf f{t) of the waiting times to generate first- 
generation events is exponential: 



f{t)=ae--' ^ f{u) = ^. (44) 

a + u 



The inverse Laplace transforms of the solutions ( 14T1) are then 

p{t) := p'''''{t) = a-e-(^-")"* (l + (m - l)7e-"(^-^)"*) , 

7Y}/ 

g{t) := p'='^(t) = a-e-(^-")"* (l - 7e-"(i-^)"*) , k^s 



(45) 



where 



I - q 

7 := 7(g, m) = — — — . (46) 

1 + (m — Ijg 

Expressions ( l45l) give the explicit time dependence of two functions p{t) and 5'(t): 

• p(t) := p^'^{t) is the rate of events over all generations of some type k resulting from 
a given mother event of the same type k. Notice that the term "over all generations" 
means that an event of type k occurring at some time t > 0, and belonging to the 
descent of some previous mother of the same type k that occurred at time 0, may have 
been generated through a long cascade of intermediate events of possibly different 
kinds, via a kind of inter-breeding genealogy. 

• g{t) := p'''^{t) is the rate of events over all generations of some type s resulting from a 
given mother event of a different type k. As for p{t), an event of type s occurring at 
some time t > 0, and belonging to the descent of some previous mother of a different 
type k that occurred at time 0, may have been generated through a long cascade of 
intermediate events of possibly different kinds, via a kind of inter-breeding genealogy. 

Figures 1 and 2 show respectively p{t) := p^'^it) and g{t) := p''''^{t) for the case of m = 3 
types of events and rather close to criticality (n = 0.99), for different coupling amplitudes 
q = 1; 0.1; 0.01. 



15 




150 



Fig. 1: Time dependence of p{t) := p^'^{t), for m = 3, n = 0.99, and q = 1; 0.1; 0.01. 
Time is in unit of 1/a. 
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Fig. 2: Time dependence of g{t) := p'''''{t), for m = 3, n = 0.99 and q = 1; 0.1; 0.01. 
Time is in unit of 1/a. 

The case g = 1 of complete coupling is special in two ways: (i) p(t) and g(t) are propor- 
tional to each other; (ii) there is only one time scale = ^ ■ jz^- In contrast, as soon as 
g < 1, i.e., events of a given type tends to trigger more events of the same type than events 



16 



of different types, one can observe that the time dependence of p(t) and g{t) become quahta- 
tively different. The monotonous decay of p{t) can be contrasted with the non-monotonous 
bell-shape dependence of g{t). This non-monotonous behavior of g(t) results from the pro- 
gressive seeding of events of a different type than the initial mother type by the less efficient 
mutual excitation process. This is associated with the introduction of a second time scale 
T2 = ^ ■ jz:^ ^ '^1 controlling the dynamics of both p(t) and g(t) at short times. This effect 
is all the stronger, the smaller q is, i.e., the larger 7 is. 

This phenomenon of the occurrence of a second time scale T2 and of the distinct behavior 
of g{t) := p^''^{t) for g < 1 constitutes a characteristic signature of the mutual excitation 
mechanism, in a system in which the time response function is exponential (Poisson, i.e., 
without memory). The cascade of triggering together with the inter-breeding of events of 
different types break the Poissonian nature of the relaxation of the event activity triggered 
by a given mother ancestor. This is different from what occurs for a single event type m = 1 
for which the existence of multiple generations do not change the Poissonian nature of the 
relaxation process. It only extend the time scale according to ri = ^ • as the average 
branching ratio n increases to the critical value 1. 

D. Power law pdf of triggering times of first-generation events 

The same qualitative picture emerges for other pdf's such as power laws, with a 
monotonous decay of p{t) coexisting with a growth from zero up to a maximum followed 
by a decay for g{t). But more interesting features appear, such as the renormalization of 
the exponents in two distinct families, as we now show. As many systems exhibit power 
law pdf's of waiting times with rather small exponents 6 < 0.5 (see definition in expression 
P7|l ). we shall consider this regime in the following. 

For definiteness, we consider the pdf with power law tail given by 

The constant 1 in the denominator regularizes the pdf at times t < 1/a. The corresponding 
Laplace transform of (H71) is 

nu)^ee"'(^yr{-e.l) . (48) 

which can then be used in (14T|) to get the general solutions. 
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1. Non-critical same-type activity rate p{t) =: p^'^{t) 



We first rewrite the Laplace transform p{u) given by (HT!) in a form more convenient for 
its analysis: 

~p{u) = R^''^ ■ J-^^ . i±Il^ , (49) 
1 + 7oV5(n) 1 + 'j2'f{u) 



where 



and 



^{u) := 1 - fiu) (50) 



n n{l — q) n{l — q) 

7o = z , 7i = z : , 72 



n 



1 — n + gn' 1 — n + g(n + m — 1) ' /_^s 

7o > 7i > 72 (g > 0, m > 1). 
The long time behavior of p{t) is controlled by the small u properties of p{u), itself 
dependent on the behavior of (p{u) for small u. From its definition f l50|) . we have that 
if{u) — )■ for M — > 0. Then, the asymptotic behavior of the Laplace transform (149 p of p{t) is 

p{u) ~ i?'^'^ - R'''' ■ 7p<^(m) , 7p = 1 + 70 + 72 - 71 • (52) 

For 6 G (0, 1), the auxiliary function (p{u) (|50l) has the following asymptotic behavior 

(^(m) ~ < 1 , < 1 , /3 = r(l - ^) , t; = - . (53) 

a 

Accordingly, relation (132]) transforms into 

p(m) ~ i?^''^ [1 - 7,/3t;^] . (54) 
The corresponding asymptotic of the rate p{t) is thus 

P(t) - R''' ■ FTT^ = R"'' ■ 7P^T-^ , ^ ^ oo . (55) 



The rate p{t) := p^'''{t) of events over all generations of some type k resulting from a given 
mother event of the same type k that occurred at time decays with the same power law 
behavior as the bare memory function or pdf of waiting times for first-generation events. 
The only significant difference is the renormalization of the amplitude by the factor R!'''^ ■ 7p 
resulting from the cascades of generations and inter-breeding between the different event 
types. 
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2. Intermediate critical asymptotic same-type activity rate p{t) := p^'^{t) 



For n close to 1, 70 becomes large and there is an interesting intermediate asymptotic 
regime describing the intermediate time decay of p{t). To describe it, we need to distinguish 
the following three parameter regimes. 

1. 7o ^ 1 and 72 < 71 — 1. This occurs for n — )■ 1 while q is not too close to 0. For 
instance, n = 0.95, q = 0.5, m = 5 yield 72 = 0.613, 71 = 0.905, 70 = 19. In this case, 
there is an intermediate range on the w-axis defined by 

(70/3)"' < < (7i/3)'' ^ a(7o/3)-'<n<a(7i/3)-'^a, (56) 

such that 7o</?(m) ^ 1 while 71 ^^('w) ^ 1 and 72V^(^i) ^ 1. In this range, the leading 
terms controlling the value of expression fj^9l) is 

~p{u) ^ R''' ■ . (57) 



Substituting the asymptotic relation ( ]53ll . we obtain 

The corresponding intermediate asymptotic of the rate is 

Pit) ^ R'''-^^-^ , l«at « [7or(l - 9)^ . (59) 
7o TT [at)'' 

2- 7o > 7i ^ 1 ^-iid 72 ~ 1: This occurs for n — t- 1 with q close to and m large. For 
instance, n = 0.95, q = 0.01, m = 50 yield 72 = 1.68, 71 = 15.8, 70 = 19. In this case, 
there is an intermediate range on the w-axis defined by 

(7i/3)"' < < (72/3)"' ^ a(7i/3)"'<n<a(72/3)"'^a, (60) 

such that 7o</'(m) > 7iV^(m) ^ 1 while 72V5(m) <^ 1- In this range, the leading terms 
controlling the value of expression fj49|) is 



piu) = R''' ■ ^ ■ (1 - ^(u)) , (61) 
7o 

whose inverse Laplace transform has the same form as fl55l) with 7p replaced by 1. 
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3. 7o > 7i > 72 ^ 1: This occurs for n — )■ 1 with q close to and m not too large. For 
instance, n = 0.95, q = 0.01, m = 2 yield 72 = 13.5, 71 = 15.8, 70 = 19. Then, in the 
intermediate interval on the w-axis 

(72/3)"^ < < 1 ^ a (72/3)^'' < n < a , (62) 

the asymptotic relation ( l53l) holds, while at the same time 'y2f{u) ^ 1. In this range 
fl62p . the leading terms controlling the value of expression f l49p is 

1 .2l»^.fl".^ 1 . (63) 

7oV5(m) 72V^(m) 7o72 V^(m) 

Using the asymptotic relation (!53|) . we obtain 

P(«) ^ ^ G = R"'" ■ = R"'" ■ f^T^jT • (64) 

7072P 7o72r(l - 9) 

The corresponding intermediate power asymptotic of the rate p{t) is 

Pit) ^ R'^'^'^^^ , l«at « [72r(l - 9)r . (65) 
7o72 71" (at)' " 



As an illustration, for the above values n = 0.95, q = 0.01, m = 2, the power law mbh 
with exponent 1—9 holds up to a maximum time [721(1 - 9)]^^^ a'^ ^ 75, OOOa^^ for 
9 = 0.25 . 

Let us summarize and interpret the above results, 

1. — )■ 1 and q not small (70 ^ 1 and 72 < 71 — 1). The intermediate power law 
asymptotic ( |59l) with exponent 1 — ^ is similar to the renormalized response function 
due to the cascade of generations found for the self-excited Hawkes process with just 



one type of events [15|, 



51 



561]. The mechanism is the same, since a coupling coefficient 



q not too small ensures a good mixing among all generations. 

2. — )■ 1 with g — )■ and m — )■ 00 with qm ~ 1 (70 > 71 ^ 1 and 72 — 1). In 
contrast with the previous case, the activity rate p(t) exhibits the same decay (!55|l 
with exponent 1 + 6' as if the system was far from criticality. In a sense, due to the weak 
mutual triggering efficiency and the many event types, the system is never critical. 

3. — )■ 1 with g — )■ and m not too large such that qm ^ 1 (70 > 71 > 72 ^ 1). 
The intermediate power law asymptotic ( |65l) with exponent 1 — is again similar to 



the renormalized response function due to the cascade of 
self-excited Hawkes process with just one type of events |l5 



generations found for the 



51 



56|. 
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3. Asymptotic and intermediate critical asymptotic inter-type activity rate g{t) := p^'^{t) 



In order to obtain the time-dependence of g{t), we express its Laplace transform g{u) 
iwen in expression fHTl) in a form analogous to 



1 + 7oV5(u) 1 + 72V5(m) 
Three regimes can be distinguished. 

1. Asymptotic regime of long times for n < 1. At long times, the asymptotic 
relation ( l53l) holds true. Then, analogous to ( 15^ and ( l55l) . we obtain the following 
asjTiiptotics 

(67) 

This power law decay with exponent 1 + 9, equal to the exponent of the memory 
kernel fl47p , is characteristic of the non-critical regime in which only a few generations 
of events are triggered in significant numbers. 

2. Intermediate asymptotic regime (n — )■ 1 with g — )■ and m large). Then, 
7o ^ 1 and 72 — 1. This is the same second regime analyzed in subsection IV D 2l In 
this case, there is an intermediate asymptotic in the range defined by fIBU]) such that 
the following approximate relation holds 

g{u) ^ , s . (68) 

70 (p{u) 

The corresponding intermediate power asymptotic of g{t) := p'^'^{t) is 

« S^^j^i _ 1 « l^,„r(i - of" . (69) 

7o Tc [at)^ 

This power law decay with exponent 1 — ^ is significantly slower than the previous one 
with exponent 1 + 6* and results from the proximity to the critical point n = 1. 

3. Intermediate asymptotic regime (n — )■ 1 with g — )■ and m small). Then, 
72 given in (!5T]) is large and there is an intermediate interval (!62|) for u such that, 
analogous to the following approximate relation holds 

~g(u) ^ R''^ ■ ■ = R''^ ■ ^ . (70) 

7o^{u) 72V(^) 7o72 ^ [u) 
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Using the power asymptotic ( 153|) . we obtain the intermediate power law 

1 "fc,s 1 



g(u) ^ Q V 



'20 



R 



R 



(71) 



7o72/3 7o72r(l - 0) 

Accordingly, the intermediate power law asymptotic of the inter-type activity rate 

g{t) := p'^'^{t) reads 



9(t) 



R 



1 



^ , 1< at < [72r(l 



(72) 



7o72r(20)r(i - 0) {aty 

This power law decay with exponent 1—26 is similar to the decay after an "endogenous" 



)eak, as c^ 
52 
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assified in previous analyses of the monovariate self-excited Hawkes process 
, Is^]. Indeed, the exponent 1 — 26, corresponding to a very slow power law 
decay, has been until now seen as the characteristic signature of self-organized bursts 
of activities that are generated endogenously without the need for a major exoge- 
nous shock. Here, we see this exponent describing the decay of the activity of events 
triggered by an "exogenous" mother shock of a different type, in the critical regime 
n — )■ 1 and for weak mutual coupling g — )■ 0. It is clear that the mechanism is different 



from the previously classified "endogenous" channel 
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involving here an 



interplay between the cascade over generations and the weak mutual excitations. 




Fig. 3: Time dependence of p{t) := p^'^{t) and g{t) := p^'^{t) in double logarithmic 
representation for n = 0.95, q = 0.01, m = 2, and 6* = 0.25 {1 + 6 = 1.25, 1-61 = 0.75, 
1 — 26 = 0.5). Time is in unit of a~^. The functions p(t) and g{t) have been calculated 
numerically from their complete Laplace transforms (|4ip . 
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Figure 3 shows the time dependence of both p(t) := p^'^it) and g{t) := p^''^{t) in the 
regime n — )■ 1 with g — t- and m small, for which there exists an intermediate asymptotic 
of the third type both for p{t) and g{t). For p(t), one can clearly observe the intermediate 
power law asymptotic with exponent 1 — = 0.75 followed by the final asymptotic power 
law with exponent 1 + 9 = 1.25. For g{t), the intermediate power law asymptotic with 
exponent 1 — 2^ = 0.5 is clearly observed, followed by the same final asymptotic power law 
with exponent 1 + 9 = 1.25. 



VI. ONE-DIMENSIONAL CHAIN OF DIRECTED TRIGGERING 



A. Definitions 



We consider a chain of directed influences k ^ k + 1 where the events of type k trigger 
events of both types k and k + 1 only (and not events of type A; — 1 or any other types), 
and this for k = 1, 2, m. This is captured by a form of the matrix N which has only the 
diagonal and the line above the diagonal with non-zero elements. 

As the simplest example, we shall study networks of mutual excitations corresponding to 
the following matrix of the mean numbers of first-generation events 



N 



X e 0. 

0x^0 0. 

X e 0. 

X e 0. 



(73) 



where 



n 



X 



l + q 



nq 
l + q 



(74) 



B. Laplace transform of the event activities p '^{t) defined in ([29|) 



In order to derive the equations governing the rates p^'''^(t), we need to recall a result 
concerning the total numbers of events R^''' and R^'^ generated by a given mother of type 

581 R''' = R^'' = R 



k. Assuming that the mother event is of type k, we have 



for 
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1 < s < k and 



1 — X 1 + q — n 

(75) 



Then, the Laplace transforms p^'^{u) ( l32l) of the rates p^'^{t) are given by the right-hand 
sides of expressions ( 1751) . with the following substitutions 



(76) 

This yields 



(77) 

p^-^(«) := ^„(«) = . m = s-k>0. 

C. Exponential pdf f{t) of triggering times of first-generation events 

We use the parameterization (jSj) for the pdf f(t), which leads after calculations to 

p'^'^t) := pit) = ax e-(i-^)'^* , 

, (78) 

pfc'-(t) := gjt) = ^(^atr-\m + xat) e'^^-^^)"* , m = s - k > . 
ml 

The rate p^'^{t) := p{t) of events of the same type as the mother decays simply as an 
exponential with a characteristic decay time ^^'^^ ot'^-, which exhibits the standard critical 
slowing down at the critical value of the mean branching ratio ric = 1 + q. In contrast, the 
cross rates p^'^^it) := gmif) exhibit a non- monotonous behavior, which reflects the directed 
nature of the mutual triggering of events of different types. For large m values, the cross-rate 
becomes almost symmetrical functions of time, as shown in figure 4. 
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Fig. 4: Time dependence of the cross-rates p^'^{t) := gm{t) given by ([78]) for n = 0.95, 
q = 1 and different m values. 

D. Power law pdf of triggering times of first-generation events 

The time dependence of p^'^{t) := p{t) given by the first equation of (fTfl) when f{t) is 
given by relation ( H71) with Laplace transform ( l48l) is the same as for the monovariate Hawkes 
process (with a single event type), with the modification that the role of the mean branching 
ratio n is replaced by x- The rate p{t) exhibits an intermediate power law asymptotic with 
exponent 1 — up to a cross-over time ~ a~^/{l — x)^ followed by the asymptotic power 
law decay with exponent 1 + ^ corresponding to the memory kernel f{t). 

Interesting new regimes appear for the time dependences of the cross-rates gm{t)- We first 
express the Laplace transforms gmiu) given by (1771) of the cross-rates by using the auxiliary 
function ^{u) defined by (l50l) : 



and the mean number i?^'* {k ^ s) is given by expression (1751) . Replacing ip{u) by its 




(79) 



where 



7 = 



1 — X 1 + q — n ^ 



(80) 
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asymptotic ( 153|) . we obtain the asymptotic formula 

(1 - Bv^y 



The long time asymptotic of gm{t) is controlled by the behavior of gm{u) for f — )■ 0, whose 
leading order is given by 

gm.{u) ~ R^''' [l - 7(m)t;''] , t; -> 

(82) 

7(m) = /3(m + (m + 1)7) . 

This expression holds true for 7 < +00, i.e., n < 1 + g, where the upper bound nc = 1 + q 
define the critical point. Accordingly, the main asymptotic of the cross event rate gm{t) is 

This recovers the usual long time power law dependence, which is determined by the memory 
kernel f{t) of waiting times for first-generation triggering. 

There is also an intermediate asymptotic regime present when 7 3> 1, i.e., n — )■ 1 + g 
from below. Specifically, the intermediate asymptotic domain in the variable v is defined 
by the interval (/37)^^/^ <^v<^l, such that 7/3f^ ^ 1 while v <^1. Then, the asymptotic 
relation fl53|) is true, and expression flHTl) can be simplified into the approximate relation 

^^ = _^_, (/37)-V^ « . « 1 . (84) 

Accordingly, analogous to f l72l) . we obtain 

This expression f l85|) predicts a hierarchy of exponents 1 — (m + 1)^ characterizing the 
intermediate asymptotic power law dependence of the rates gmif) '■= p'^'*(t) of events of tj^e 
s as a function of the distance m = s — k along the space of types from the type k of the 
initial triggering mother. Figure 5 illustrates this prediction (l85l) for m = 1; 2 with 6 = 0.25, 
leading to the two intermediate asymptotic exponents 1 — 2^ = 0.5 and 1 — 36 = 0.25. 
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Fig. 5: Time dependence of the rates gi{t) := p^'^~^^{t) (upper curve) and g2{t) '■= 
pk,k+2^^^ (lower curve) of events of type s = k + 1 and s = k + 2 triggered by a 
mother of type k. The parameters are n = 0.99, q = 0.01 and 9 = 0.25. The dashed 
straight hnes correspond to the power laws predicted in the text for the asymptotic 
and corresponding intermediate asymptotic regimes. 

The intermediate power law decay laws with exponents 1 — {m + 1)6 hold only when 
this exponent is positive, i.e., for m < | — 1. To understand what happens for larger m's, 
a more careful analysis is required, which is presented in Appendix B, which shows that 
formula f l85|) still holds and predicts that gm{t) is an increasing function of time for times 
at < (7/3)^''^ before decreasing again with the standard asymptotic power law ~ This 
is summarized by figure 6, which plots the time dependence of the rates gm{t) '■= p^'^'^'^{t) of 
events of type s = k + m triggered by a mother of type for m = to 5, with ^ = 1/3. One 
can clearly observe the existence of the intermediate power asymptotics (equation fll23p 
in Appendix B and expression ( |85ll ) for different values of m. When inequality f ll24p of 
Appendix B holds, the intermediate asymptotics are not decaying but growing as a function 
of time, as predicted by expression (11231) of Appendix B and (|85|) . 
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Fig. 6: Time dependence of the rates gm{t) '■= of events of type s = k + m 

triggered by a mother of type k, for m = (same type of events as the initial triggering 
mother) and m = 1,2,3,4 and 5. Here, 6 = 1/3 and 7 := In (^i^) = 0.01. The 
number of summands used in the sum (I106P of Appendix B is = 1500. 

VII. ONE-DIMENSIONAL CHAIN OF NEAREST-NEIGHBOR-TYPE TRIG- 
GERING 

A. Definitions 

A natural extension to the above one-dimensional chain of directed triggering discussed 
in the previous section includes feedbacks from events of type A; + 1 to type k. The example 
treated in the present section corresponds to fully symmetry mutual excitations confined to 
nearest neighbor in the sense of event types: k ^ k + 1. Mathematically, this is described 
by a symmetric matrix N of the average numbers Uk^s of first-generation events of different 
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types triggered by a mother of a fixed type. 

We assume that all diagonal elements are equal to some constant x (same self-triggering 
abilities) and all off-diagnoal elements are equal to some different constant ^ (same mutual 
triggering abilities). The elements ni_m and also equal to ^ to close the chain 

of mutual excitations between events of type 1 and of type m. Restricting to m = 6 for 
illustration purpose, the corresponding matrix reads 

"x e e" 

e X e 

0^X^00 

e X e 

e X e 

e e X 



N 



(86) 



where 



n 



X 



l + q 



nq 



X + 2C = n . 



(87) 



2(1 + g) 

As before, the parameter q quantifies the "strength" of the interactions between events of 
different types. Here, n represents the total number of first-generation events of all types that 
are generated by a given mother of fixed arbitrary type. Figure 7 provides the geometrical 
sense of matrix ( 186|) for m = 6, where the circles represent the six types of events and 
the arrows denote their mutual excitation influences. 
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Fig. 7: Geometric sense of the matrix N for a one-dimensional chain of nearest- 
neighbor triggering in the space of event types. 



B. Analysis of the event rates p^'^{t) 



The Laplace transform p^'^{u) of the event rates p^'^{t) fl29l) of type k that are triggered 
by a mother of the same type k reads 



P'^^^u) ■.= p{u) = A[nf{u),q] , 



where [58 1 



An{l — n + qY — {1 — n + q){5n — 2g — 2)n^q^ — n^q'^ 



A{n,q) 



4(1 - n + g)4 - 5(1 - n + g)%2g2 ^ ^4^4 
Analogously, the Laplace transforms of the cross-rates p^''^{u) are 



gi{u) = B[nf{u), q], g2{u) = C[nf{u), q], g-^iu) = D[nf{u), q] 



where [58 1 



nq{l + g)(2(l — n + qy — n^q^^ 



B{n,q) 
C{n,q) 
D{n,q) 



4(1 


-n + q)"^ 


— 5(1 — n + qYri^q^ 


+ n'^q^ 




n^q^ 


[l + g)(l -n + g) 




4(1 


-n + qY 


— 5(1 — n + qYri^q^ 


+ n^q* 






n^q^il + q) 





(88) 



(89) 



(90) 



(91) 



4(1 - + g)4 _ 5(1 - 72 + q^n'^q'^ + n^q'^ ' 
Figure 8 shows the time dependence of p(t), giit), g2(t) and g^it) for the case where 
the pdf f{t) is a power law f H7|) . for the parameters n = 0.995, g = 0.01,6* = 0.2. One 
can observe a common power law asymptotic ~ t^^^^ = t^^ "^ at large times, as well as 
intermediate asymptotic power laws 



-1+20 _ ^-0.6 



(92) 



92it) ~ = g^it) ~ = 
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Fig. 8: Top to bottom: the solid lines represent the time dependence of p{t), gi{t), 
g2{t) and gsit), in the case a one-dimensional chain of nearest-neighbor- type triggering 
in the space of types, with six types. The parameters are n = 0.995, q = 0.01, 9 = 0.2. 
The dashed straight lines show the asymptotic and intermediate asymptotic power 
laws predicted in the text. 



VIII. CONCLUDING REMARKS 



We have presented a preliminary analysis of some temporal properties of multivariate 
self-excited Hawkes conditional Poisson processes. These processes are very interesting can- 
didates to model a large variety of systems with bursty events, for which past activity 
triggers future activity. The term "multivariate" refers to the property that events come 
in different types, with possibly different intra- and inter-triggering abilities. The richness 
of the generated time dynamics comes from the cascades of intermediate events of possibly 
different kinds, unfolding via a kind of inter-breeding genealogy. We have developed the 
general formalism of the multivariate generating moment function for the cumulative num- 
ber of first-generation and of all generation events triggered by a given mother event as a 
function of the current time t. We have obtained the general relations for the mean numbers 
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of events triggered over all generations by a given event as a function of time. We have ap- 
plied this technical and mathematical toolbox to several systems, characterized by different 
specifications on how events of a given type may trigger events of different types. In partic- 
ular, for systems in which triggering between events of different types proceeds through a 
one-dimension directed or symmetric chain of influence in type space, we have discovered a 
novel hierarchy of intermediate asymptotic power law decays of the rate of triggered events 
as a function of the distance of the events to the initial shock in the space of types. We have 
been able to derive the time-dependence of the rates of events triggered from a given shock 
for distributions of waiting times of first-generation events that have either exponential or 
power law tails, for a variety of systems. Future directions of investigations include the study 
of more realistic networks in type-space and of the full distribution of even rates, beyond 
the mean dynamics reported here. 
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Appendix A: Proof of theorem 13.11 

Substituting relation (IT^ in expression f[T^ leads to 



oo 



oo 



^livi, ?/2, • • • , = X] ■ ■ ■ 



iil=0 dm=0 



(93) 




oo oo in 



Inverting the order of the summations 




(94) 



ds=0 rs=ds 



rs=0 ds=0 
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oo oo 



we rewrite expression ( p3|) as 

A^ivi, y2,. . .,ym;t) = ^-- ■ Pkin, . . . 

ri=0 rm=0 

ri Tm ra ^ 

— n ^ — n o— 1 V 



(95) 



Ts—ds 



or equivalently 



oo oo 



A\{yi, 7/2, • • • , = XI ■ ■ ■ 5Z ^'^^'^l 



fi=0 rm=0 



r. 



Using the binomial formula 



(96) 



we obtain 



(97) 



00 00 



A\{y^, y2,...,yn,;t) = J2---Yl ^'^(^i' • • • ' + /"A.,s(t)(i/ - !)]'•= . (98) 

'"1=0 rm=0 s=l 

In view of definition ([8]) of the GMF A^{yi,y2, . . . , ym), this last expression means that 

A'liyi, 2/2, ... , ym] t) = A\ [1 + iik,i{t){yi - 1), . . . , 1 + iik,m{t){ym - 1)] . (99) 
Using definition ( !T6|) of the function Qk, we obtain relation (fT5|) . ■ 

Appendix B: Analysis of the behavior of gm{t) '■= p^'^{t) for a one-dimensional chain 
of directed triggering of section IVII for n — t- 1 + g when 1 — (m + 1)6* < 

Let us start with expression gm{u) fl77|) that we rewrite, omitting the nonessential factor 
r, as 

f^iu) n 
[1 - X ■ /(^^)]™+' 1 + 5 

Using the binomial formula 

1 f (101) 



(1 - x)™+i ^ V ^ 

^ ' k=0 ^ 
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expression (llOOp becomes 

uu)=f:(^^^yr-'\u). (102) 

As we are interesting in the case where the pdf f{t) has the power asymptotic f{t) ~ 
with < < 1, it is convenient to use for f{t) one special representative of the 
functions presenting this asymptotic power law behavior, namely the one-sided Levy stable 
distribution of order 6 59|, that we refer to as feit). Its Laplace transform is 

= e-"*, < ^ < 1 . (103) 

Accordingly, relation fll02p takes the form 

~9m{u) = Y.hl%'-e-^-^'>\ (104) 

fc=0 ^ ^ 

Taking the inverse Laplace transform of (11041) provides us with the exact expression 

9^{t) = g + ^) ■ j^^^fj^ ■ fe ( (;;^^) • (105) 
In order to analyze ( llOSp . it is convenient to rewrite it as 

k=0 ^ ^ 

where 



7 = In ( i ) = In ( ) > forn < 1 + g . (107) 



We have defined the functions 



and 



such that 



Sm(x) := x( ), x^m, (108) 
m 



In order to extract the relevant information from expression (11061) for gm{t), we need to 
discuss some properties of the two functions Sm{x) and Qe{x). 
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Properties of the function Sm{x). The function Sm{x) is a finite sum of power 
functions of the argument x 

m 

Sm{x) ='^ar.m X'^'^ . (Ill) 
r=l 

In particular, 

So{x) = X, Si{x) = S2{x) = ^ - ^ x% 

53(0;) = - x^ x"" + - x\ (112) 
; g 2 3 ^ ^ 

SJx) = — x"" X -\ x^ X . 

^ ^ 24 4 24 4 

Properties of the function Qg{x). For 6 G (0, 1/2), this function is at least expo- 
nentially decaying with increasing x. Accordingly, its moments of any order r > are 
finite and given by 



00 



M(r) := / x^ Qe{x)dx = • (US) 







Moreover, the value of Qei^x) at a; = is equal to 

Qoi^ = ^) = f^^y (114) 

For the particular cases ^ = 1/2 and 6 = 1/3, the function Qe{x) can be expressed in 
explicit form: 

Qi/2{x) = exp , Qv3(^) = ^ • Ai . (115) 

We study the behavior of gm.{t) given by expression fll06p for 7m ^ l,t^ ^ 1 and 
m ^ 1. To leading order and without essential error, we may replace the discrete sum 
f ll06p by the continuous integral 

6 /x\ 

Using the following change of variable of integration 

X ^ y = ^ O x = t%, (117) 

we obtain 

n poo 

g^t) ^ - / SUt%)Qe{y)e-'"'ydy . (118) 
^ Jo 
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Using relation (lllip . this yields 

B ™ 

g^{t) ar,mt^'~''^'Gr,mit) , (119) 

r=l 

where 

POO 

Gr,m{t) = / /+'ge(l/)e-^*'^rf|/ . (120) 
Jo 

The intermediate asymptotic regime corresponds to the time domain 'yt^ ^ 1 with ^ 1. 
In this case, the exponential in the integral fll20p can be replaced by unity. Using relations 
(11131) . we obtain that 

f°° T(r 4- 2) 

Gr,m = / f^'Qe{y)dy = , it' « 1 , (121) 



.0 r[(r + 1)^+1] 

is time independent. Accordingly, the mean rate gm{t) (I119P is found as the sum of power 
law functions 

m 

g^t) ^ e ■ . ^ a,,„a,m ■ t^^-'")' . (122) 

r=l 

Taking into account that we consider the case ^ 1 (that allowed us to use the integral 
approximation (I116p ). we obtain the sought power law intermediate asymptotic 

T[{m + 1)9 + IJ 

This recovers the result f l85|) presented in the main text. In addition, it makes more precise 
what happens for 

(m + l)^>l. (124) 

In this case, gmit) starts as a growing function of t up to t ~ 7^^/^. This retrieves the 
same qualitative behavior found when f{t) is an exponential, which has been analyzed in 
subsection IVI CI and represented in figure 4. 

Of course, at times t ^ 7~^^^, this growth is replaced by the standard power law decay 
~ Indeed, for jt' ^ 1, the integral (I120p is approximately equal to 

Gr,mit) ^ QeiO) f y^-^'e-^^'^dy = f^^l-'^-'t-^'^'^' ■ (125) 
Substituting this relation into (I119p yields 



r=l '■ 



1/9 



(126) 
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Figure 6 in the text sums up these results by plotting the time dependence of the rates 
fi'm(^) := p^'^^^{t) of events of type s = k + m triggered by a mother of type k for m = 
to 5. One can clearly observe the existence of the intermediate power asymptotics f ll23p for 
different values of m. When inequality f ll24p holds, the intermediate asymptotics are not 
decaying but growing as a function of time, as predicted by expression f ll23p . 
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